Reinforcement learning over time: spaced versus massed training establishes stronger value associations
نویسندگان
چکیده
Over the past few decades, neuroscience research has illuminated the neural mechanisms supporting learning from reward feedback, demonstrating a critical role for the striatum and midbrain dopamine system. Learning paradigms are increasingly being extended to understand learning dysfunctions in mood and psychiatric disorders as well as addiction in the area of computational psychiatry. However, one potentially critical characteristic that this research ignores is the effect of time on learning: human feedback learning paradigms are conducted in a single rapidly paced session, while learning experiences in ecologically relevant circumstances and in animal research are almost always separated by longer periods of time. Event spacing is known to have strong positive effects on item memory across species and in reward learning in animals. Remarkably, the effect of spaced training on human reinforcement learning has not been investigated. In our experiments, we examined reward learning distributed across weeks vs. learning completed in a traditionally-paced or “massed” single session. Participants learned to make the best response for landscape stimuli that were either associated with a positive or negative value. In our first study, as expected, we found that after equal amounts of extensive training, accuracy was high and equivalent between the spaced and massed conditions. However, in a final online test 3 weeks later, we found that participants exhibited significantly greater memory for the value of spaced-trained stimuli. In our second study, our methods allowed for a direct comparison of maintenance of conditioning. We found that spaced training again had a beneficial effect: more than 87% of conditioning was maintained for spaced-trained stimuli, while only 30% was maintained for massed-trained stimuli. In addition, supporting a role for working memory in massed learning, across both studies we found a significant positive correlation between initial learning and working memory capacity. Our results indicate that single-session learning tasks may not lead to the kind of robust and lasting value associations that are characteristic of “habitual” value associations. Overall, these studies begin to address a large gap in our knowledge of fundamental processes of human reinforcement learning, with potentially broad implications for our understanding of learning in mood disorders and addiction. . CC-BY-NC-ND 4.0 International license peer-reviewed) is the author/funder. It is made available under a The copyright holder for this preprint (which was not . http://dx.doi.org/10.1101/158964 doi: bioRxiv preprint first posted online Jul. 3, 2017;
منابع مشابه
Effects of spaced versus massed training in function learning.
A robust finding in the literature is that spacing material leads to better retention than massing; however, the benefit of spacing for concept learning is less clear. When items are massed, it may help the learner to discover the relationship between instances, leading to better abstraction of the underlying concept. Two experiments addressed this question through a typical function learning t...
متن کاملNeurogenesis and the spacing effect: learning over time enhances memory and the survival of new neurons.
Information that is spaced over time is better remembered than the same amount of information massed together. This phenomenon, known as the spacing effect, was explored with respect to its effect on learning and neurogenesis in the adult dentate gyrus of the hippocampal formation. Because the cells are generated over time and because learning enhances their survival, we hypothesized that train...
متن کاملPKC differentially translocates during spaced and massed training in Aplysia.
Learning is highly regulated by the pattern of training. In Aplysia, an important organism for the development of cellular and molecular models of learning, spaced versus massed application of the same stimulus leads to different forms of memory. A critical molecular step underlying memory is the serotonin (5HT)-mediated activation of the novel PKC Apl II. Here, we demonstrate that activation o...
متن کاملDifferences in procedural knowledge after a “spaced” and a “massed” version of an intensive course in emergency medicine, investigating a very short spacing interval
BACKGROUND Distributing a fixed amount of teaching hours over a longer time period (spaced approach) may result in better learning than delivering the same amount of teaching within a shorter time (massed approach). While a spaced approach may provide more opportunities to elaborate the learning content, a massed approach allows for more economical utilisation of teaching facilities and to opti...
متن کاملTemporally massed CS presentations generate more fear extinction than spaced presentations.
Rodent fear conditioning models both excitatory learning and the pathogenesis of human anxiety, whereas extinction of conditional fear is a paradigm of inhibitory learning and the explicit model for behavior therapy. Many studies support a general learning rule for acquisition: Temporally spaced training is more effective than massed training. The authors asked whether this rule applies to exti...
متن کامل